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(54) Apparatus and method for high speed Imaging 



(57) A high ^eed imaging apparatus for high speed 
imaging in two dimensions is described. The apparatus 
comprises a plurality of image storing devices 1 to 8 
arranged for receiving and storing images in two dimen- 
sions, exposure means for exposing respective ones of 
the devices to respective images of a sequence of 
images received by the apparatus, erasure means for 
erasing any previously stored image in the device to be 
exposed prior to exposure, read means for reading 
images stored in said devices, and stop means for stop- 



ping the exposure of said devices and the erasure of pre- 
viously stored images when the apparatus receives a 
trigger signal representing occurrence of an event. This 
enables at least one image received by the apparatus 
before receipt of the trigger signal to be read from the 
apparatus after receipt thereof. The apparatus therefore 
provides for recordal, and subsequent retrieval of image 
information relating to an event received prior to detec- 
tion of the event. 



Grosd Qrssdt) 



15v 



Gated Irwge tntenaltei 

3^ Shutter 




HguroS 



BEST AVAILABLE COPY 



Primed by Rank Xarax jUK) Bustress Services 
2.9.12/3.4 



11/13/2002, EAST Version: 1.03.0007 



1 



EP0 701 185 A1 



2 



Description 

This invention relates to an apparatus and method 
for high speed imaging in tw dimensions. The invention 
may be applied to framing cameras for permitting pho- 
tography of high or ultra high speed events which typi- 
cally occur over time scales in the order of nanoseconds 
to milliseconds. 

Various types of framing cameras are known in the 
art with speeds of 2000 to 100.000,000 frames per sec- 
ond. Framing cameras of this type are used for taking 
pictures of high or ultra high speed events such as light- 
ening and sparks resulting from electrical discharge, or 
events to be analysed to a high resolution such as in 
Shockwaves, fluid dynamics and fuel injection. An in^ge 
tube of the type described in EP patent specification 0 
315 435 can be used in such a framing camera for 
recording these high speed events. Generally speaking, 
the duration of the event which can be record^ by the 
image tube is inversely proportional to the number of 
frames per second. Consequently the greater the reso- 
lution required of the event being recorded, the smaller 
the running time of the image tube. In these drcunrv 
stances, it is necessary to predict the precise timing of 
the event so the image tube can be triggered to record 
the event as rt occurs. 

In practice, the precise timing of events and physical 
phenomena to be recorded and analysed Is often unpre- 
dictable. For example, it may be desired to record the 
early stages of electrical breakdown which occur in light- 
ening and subsequently study the characteristics of this. 
As the timing of the lightening cannot be predicted, by 
the time the main lightening strike is detected and the 
image tube triggered, the discharge events immediately 
preceding the main strike have been missed. A similar 
situation occurs in the study of plasma streamers prior 
to breakdown. It is only usually at breakdown itself that 
the image tube is triggered and so the pre-breakdown 
stage is missed. 

A previously proposed method of overcoming this 
problem is to use a film or video camera. The camera is 
triggered to start before the event is expected and is 
stopped once the event has occurred - it Is no problem 
to detect the main event and so stop the camera then. 
However to do this usuall y necessitates running the canv 
era for several seconds and so this method has the dis- 
advantage that to be sure of capturing the event, a large 
amount of film or video for analysis is used. This is par- 
ticularly burdensome when it is considered that in many 
cases, the critical part of the event to be recorded only 
lasts for a few frames. Another problem with these sys- 
tems is that generally the video and film systems can only 
operate at about 100,000 frames per second or less 
which severely conripromises the temporal resolution of 
the recorded event The frame rate is limited by the film 
or tape transport speed. If CCD cameras are used, the 
frame rate is usually limited by the readout rate. 

It Is an aim of the present invention to provide an 
apparatus and method which provides for recordal and 



subsequent retrieval of image information relating to an 
event received prior to detection of the ev nt 

It is another aim of the invention to provide an appa- 
ratus for high speed imaging in two dimensions which 

5 can be used as a high speed framing camera for record- 
ing an unpredictable event of short duration at high tem- 
poral resolution. It is also an aim of the invention to 
provide a method for high speed imaging in two dimen- 
sions for recording an unpredictable event of short dura- 

10 tion at high resolution 

According to the present invention, there is provided 
a high speed imaging apparatus for high speed imaging 
in two di mensions, comprising a plurality of image storing 
devices arranged for receiving and storing images in two 

IS dimensions, exposure means for exposing respective 
ones of the devices to respective images of a sequence 
of images received by the apparatus, erasure means for 
erasing any previously stored image in the device to be 
exposed prior to re-exposure, read means for reading 

20 images stored in said devices, and stop means for stop- 
ping tiie exposure of said devices and the erasure of pre- 
viously stored images when the apparatus receives a 
trigger signal representing occurrence of an event, 
whereby at least one image received by tiie apparatus 

25 before receipt of the trigger signal can be read from the 
apparatus after receipt thereof. 

The erasure means may be operative for erasing the 
previously stored Image immediately prior to exposure 
of the device to be exposed so that only one of the 

30 devices has no stored image at a time. Alternatively, the 
apparatus may include means for erasing two or more 
devices ahead of the one being exposed so that image 
information received by the device after as well as before 
the trigger signal can be recorded and subsequentiy 

35 read from the apparatus. In this case, an apparatus hav- 
ing N devices (where N is more tiian two) up to N minus 
M (where M is 1 to N) of these may have no stored image 
at any given time so tiiat at the time of receipt of the trig- 
ger signal. N minus M devices are available to store up 

40 to the next N minus M images following tiie trigger signal 
and M device(s) contain(s) an image received by the 
apparatus before the trigger signal. In this case, tiie 
apparatus can be run faster after receipt of the trigger 
signal as the erase time is no longer a limiting factor. An 

45 apparatus in which N/2 of the devices have no stored 
image on receipt of the trigger signal and N/2 devices 
have stored Images before receipt of the trigger signal 
provides for the storage of the same number of images 
either side of tiie trigger signal. 

so Each device has af inite eraseperiod. Consequentiy. 
commencement of erasure of an image stored in a 
device must begin at least one erase period prior to expo- 
sure. The exposure time of the devices may be typically 
variable from about a few nanoseconds upwards and tiie 

55 time interval between the completion of exposure of one 
of the devices and commencement of exposure of the 
next device nhay also be varied from zero upwards. The 
exposure and interframe times may be the same prior to 
receipt of the trigger signal. However, th exposure time 
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might be much shorter, for example, f the order of 1 00ns 
(exposure) to 900 ns (interframe period). One possibi 
application for this 1 :9 ratio might be when it is desired 
to capture high speed events. 

The imag storing devices may be semiconductor 
devices, for example, charged-coupled devices (CCD's). 
In embodiments of the invention, the number of devices 
may be between four and eight but a number outside that 
range might be adopted depending of the application of 
the apparatus. In a pretended arrangement, eight devices 
are used (N=8). Each one of the devices may be provided 
with an image intensif ier. The N devices are exposed in 

sequence 1 , 2.3 7,8. At the end of the sequence, the 

exposure cycle can begin again as the first device of the 
sequence will be erased. 

Although the time taken to read out CCD's Is too slow 
(at high framing speed) to allow stored images to be read 
out in real time, this is not a factor which limits the oper- 
ation speed. This Is because CCD's can be erased or 
wiped clean in a fraction of the time (in the order of a 
microsecond) it takes to read information from them. The 
stored Images do not need to be read out until after 
receipt of the trigger signal. An anti-blooming gate, con- 
ventionally used to stop glare and saturation In solid state 
in^ging devices by leaking away excessive charge, may 
be used to erase the image stored in the devices. Alter- 
natively, other metiiods may be employed In CCD's to 
destroy the stored charge packets In their potential wells 
such as altering the substrate potential. 

According to the present invention, there is also pro- 
vided an apparatus for high speed Imaging in two dimen- 
sions, comprising a plurality of image storing devices 
arranged for receiving and storing images In two dimen- 
sions, exposure means for exposing respective ones of 
the devices to respective images of a sequence of 
images received by the apparatus, updating or substitut- 
ing means for updating or substituting respective previ- 
ously stored images in tiie devices by the step of 
exposing, means for receiving a trigger signal Indicative 
of detection of an event, means for stopping the exposure 
of the devices and the updating or substituting in 
response to receipt of the trigger signal, and means for 
reading stored images from tfie devices exposed at least 
before receipt of the trigger signal whereby at least one 
Image received by the apparatus before receipt of tiie 
trigger signal can be read from the apparatus after 
receipt of the trigger signal. 

According to the present invention, there is furtiier 
provided a method of high speed imaging in two dimen- 
sions, comprising receiving and storing images In two 
dimensions in a plurality of image storing devices, expos- 
ing respective ones of the devices to respective Images 
of a sequence of Images received by the apparatus, 
updating or substituting respective previously stored 
images in the devices by the step of exposing, receiving 
a trigger signal Indicative of detection of an event stop- 
ping til exposure of tiie devices and tiie updating or sub- 
stituting In respons to receipt of the trigger signal, and 
reading stored images from tiie devices exposed at least 



before receipt of the trigger signal whereby at least one 
image received by the apparatus before receipt of the 
trigger signal can be read from the apparatus after 
receipt of the trigger signal. 

5 The step of updating or substituting may be per- 
formed by ovenwiting the previously stored image with 
the new image. This might be affected if the detected 
event were self-luminous wherein at times before the 
event itself there is in effect no light to be recorded, hence 

10 tiie image storing device will be updating an effective 
zero level hence no erase cycle is required beyond sys- 
tem initialisation. In other words, tiie previously stored 
image is ovenvritten witii tiie new brighter Image. This 
avoids any need to bring the image storing device to an 

15 empty state by reading out the device or otiienwise eras- 
ing it prior to exposure. Alternatively, tiiis step may be 
performed by erasing the previously stored image prior 
to exposure. 

Embodiments of the method may Include erasing 
20 tiie devices immediately prior to exposure so that only 
one device has no stored image at a time. Alternatively, 
two or more devices may be erased ahead of tiie one 
being exposed so that image information received by the 
device alter as well as before the trigger signal can be 
26 recorded and subsequentiy read from tiie apparatus. 

Embodiments of the invention have tiie advantage 
tiiat they permit recording and subsequent readout of an 
event which took place at a point in time which precedes 
detection of the event. This permits an unpredictably 
30 occurring event to be captured at high temporal resolu- 
tion. 

The invention wilt now be furtiier described by way 
of example with reference to the accompanying drawings 
in which: 

35 

Figure 1 is a graph representing the timing of record- 
ing relative to the timing of an event in a prior art 
apparatus; 

Figure 2 is a schematic diagram of an embodiment 
40 of tiie invention having eight image storing devices; 
Figure 3 is a pulse diagram showing exposure and 
erasure sequences in the embodiment of figure 2; 
Figure 4 is a graph representing tiie timing of record- 
ing relative to the timing of an event in tiie embodi- 
45 ment of Figures 2 and 3; and 

Rgure 5 is a schematic diagram of an apparatus 
embodying the invention. 

Figure 1 is a graph showing the luminosity of an 
50 event against time relative to the trigger pulse of a prior 
art Image recording apparatus. Once the luminosity has 
reached an Intensity L, the presence of the event is 
detectable and a trigger signal T can be generated to 
start the image recording apparatus. The trigger pulse 
55 T is followed by a series of pulses which represent tiie 
exposure of successive cameras or image storing 
devices. As can be seen from Figure 1, the series of 
pulses, in tills case 8. show that the part of the event 
recorded is that following tiie trigger pulse T. Conse- 



3 

11/13/2002, EAST Version: 1.03.0007 



5 



EP0 701 185 A1 



6 



quently. the beginning part of the event which has a lumi- 
nosity less than L, illustrated by region A in Rgure 1 , is 
not captured by the infiage recording apparatus. 

Figure 2 schematically represents eight Image stor- 
ing devices which, in this example, are CCD cameras 
arranged in a circle. Naturally, the precise configuration 
can be varied as desired. What is inrportant is that the 
electronics knows the sequence of exposures so that the 
recorded images can be studied in the sequence in 
which they occurred in time. The optical path of each 
image frame is directed onto successive ones of the 
eight CCD cameras. This may be implemented by way 
of a static beam splitter with each CCD having a shutter- 
ing mechanism. Alternatively, the implementation may 
be by way of a rotating prism or drum camera. The arrows 
of Figure 1 indicate the direction of frame rotation. 

Figure 3 is a pulse timing diagram showing the expo- 
sure and erasure sequences for the eight cameras of Fig- 
ure 2. In this example, the cameras are exposed in the 

sequence 7, 8. 1.2 5,6 The erasure 

means is operative for erasing the image stored in the 
camera which is to be exposed next but the precise start 
time of erasure can vary provided it is completed before 
exposure begins. In the example of Figure 3, the erasure 
begins after exposure of the preceding camera is com- 
plete and ends just as the exposure begins. Only one of 
the devices has no stored image at any one time. For 
example, between the exposures of cameras 8 and 1. 
camera 1 is erased. Ti represents the interframe period. 
Ts the exposure period and Te the erasure period. The 
limitation on the framing speed of this embodiment is 
determined by the minimum time it takes to erase the 
next camera to be exposed. 

If this is implemented by way of a beam splitter and 
each CCD has an independent image intensifier acting 
as its shutter, then a fast decay output phosphor may be 
utilised in order to ensure that the phosphor had decayed 
sufficiently before re-exposure. For example, in an eight 
frame system running at 1 ,000,000 frames per second. 
7 to 8 fis is available for the phosphor to decay. Gated 
image intensifiers (with fast phosphors) are not neces- 
sarily required if a rotating mirror system is provided 
because the optical rotation itself will expose each CCD 
in turn. A separate shuttering mechanism gives the abil- 
ity to have shorter exposure. 

It can be seen from Figure 4 that when the electron- 
ics senses the presence of the ©^ent i.e. when the lumi- 
nosity reaches "L". the trigger signal stops the exposure 
and the erasure means. The electronics may be opera- 
tive to delay the actual stopping of the exposure means 
until completion of the current exposure but before eras- 
ure of the next CCD camera which would have been 
erased had the camera been left running. At this time, 
the camera has stored the eight previous frames as illus- 
trated by the area B in Figure 4. These images can be 
read out of the cameras as and when desired after the 
apparatus is stopped. It is in this way that eml50diments 
of the invention are operative to record and allow subse- 
quent readout of an event which took place before detec- 



tion of the event itself. The cameras may be read out 
slowly in order to maintain or maximise signal to noise 
(dynamic range) ratio. 

Figure 5 is a schematic drawing showing the main 

5 elements of an embodiment of the inverttion. Numerals 
1 to 8 represent eight video cameras each of which 
include a gated image intensifier (II) optically coupled to 
an erasable (resettable) CCD sensor. Existing beam- 
splitter cameras utilising eight CCD's include the Had- 

10 land Photonics camera (model 468) or the Cordin cam- 
era (model 288). The Hadland Photonics camera would 
be suitable for use In this enrt}odiment. The resulting 
CCD camera is shuttered by the image intensifier for pre- 
determined interframe and exposure periods. An image 

15 signal I incident on an objective lens OL is split into eight 
components respectively directed to the video cameras. 

The embodiment comprises electronics as follows. 
A video multiplexer 9 reads out the selected CCD cam- 
era(s) at predetermined times and exports the received 

20 image data into an image (frame) store 1 1 . The image 
store 11 may be in the form of a conventional digital 
memory area where the images received from the indi- 
vidual CCD cameras via the video multiplexer 9 are 
stored prior to display on a display 13. 

25 A shutter timing, channel sequencer and CCD Eras- 
ure (reset) Control 10 is provided for controlling the tim- 
ings within the camera. This controls the individual CCD 
channel exposures, timing, erasure, sequencing of chan- 
nels and following receipt of a trigger signal Tr (indicative 

30 of the detection of an event to be studied), the read-out 
of the individual CCD cameras via the video multiplexer 
9. A microcomputer 12 controls the running of the cam- 
era, for example, the number of frames for which the 
camera continues to run after receipt of the trigger signal 

35 Tr, and the control of input and output ports 14. 

In operation, the user determines the configuration 
of the system (i.e. exposure times, interframe periods, 
number of pre/post triggered frames) for the desired 
application by keying in control information via the input 

40 and output ports 14. The microcomputer 12 in turn 
ac(uststhe erase timing and the gating (exposure) period 
of each CCD camera/intensifier 1 to 8 to achieve the 
required configuration. The cameras will then run in 
sequence as described above, exposing, erasing each 

45 CCD just prior to re-exposure and then re-exposing each 
CCD in turn. Upon receipt of the trigger signal Tr, the run- 
ning cycle or sequence will terminate (either immediately 
or after a predetermined number of further frames) to 
turn off all of the CCD's. Each CCD will contain an image, 

50 some of which will have been captured by the apparatus 
before receipt of the trigger signal Tr. Every CCD is then 
read out via the multiplexer 9 into the frame store 1 1 from 
which it may be viewed on the display 13 and analysed. 
Variations of the embodiment will be apparent to a 

55 man skilled in the art without departing from the scope 
of the invention as defined by the claims. For example, 
instead of erasing only the camera immediately ahead 
of the one being exposed, two or mor cameras may be 
rased either simultaneously or by arranging the erasure 



4 

11/13/2002, EAST Version: 1.03.0007 



7 



EP0 701 185 A1 



8 



means to be two or more steps ahead of exposure at and 
given point in time. If this alternative is adopted, it is pos- 
sible to keep the apparatus running for a tim period fol- 
lowing the trigger signal T that con'esponds to th 
number of cameras which have b en erased. In other 5 
words, if at the time of receipt of the trigger signal T, 
there are three erased cameras, then the apparatus can 
be kept running for three subsequent exposure periods. 
The earliest three of the eight frames illustrated in the 
region 8 of Rgure 4 therefore record the first three ro 
frames to the right of the trigger pulse (represented by 
dotted lines) instead of the three leftmost frames of 
region B. The apparatus can therefore be arranged to 
record the event on either side or both sides of trigger 
signal. rs 

The apparatus ennbodying the invention has been 
described on the basis that the image storing device to 
be exposed is erased prior to exposure. It is possible to 
implement the invention without erasing or bringing the 
storing device to an empty state before exposure if the 20 
image storing device can be ovenAfl^itten so as to be 
updated to store the new image. 

Other variations are possible without departing from 
the scope of the claimed invention. For example, the 
image storing devices may be responsive to forms of 26 
electro-magnetic radiation other than visible light 
Instead of dividing the input image into the required 
number of parallel channels via a conventional optical 
beam splitter/s, the optical path may be rotated exposing 
each CCD in turn. Each separate channel may then be 30 
input into a separate CCD via a shuttering mechanism. 
The shutters are timed such that each CCD is again 
exposed in turn as in the continuous loop. As before, 
erasure takes place just prior to re-exposure. Shuttering 
may be mechanical, LCD, electro-optical, solid-state (as 35 
part of the CCD chip itself), gated image intensrfiers. or 
via the rotating optical beam itself sweeping each CCD 
in turn. With the gated image intensifier solution, a suit- 
able phosphor must be chosen for the output decay to 
be compatible with the framing speed. 40 

Claims 

1. A high speed innaging apparatus for high speed 
imaging in two dimensions, comprising a plurality of 4S 
image storing devices arranged for receiving and 
storing images in two dimensions, exposure means 
for exposing respective ones of the devices to 
respective images of a sequence of images received 
by the apparatus, erasure means for erasing any so 
previously stored image in the device to be exposed 
prior to re-exposure, read means for reading images 
stored in said devices, and stop means for stopping 
the exposure of said devices and the erasure of pre- 
viously stored images when the apparatus receives 55 
a trigger signal representing occun'ence of an event 
whereby at least one image received by the appara- 
tus before receipt of the trigger signal can be read 
from the apparatus after receipt thereof. 



2. A high speed imaging apparatus according to daim 
1, wherein the erasure means is operativ for eras- 
ing the pre\/tousIy stored image immediately prior to 
exposure of the device to be exposed so that only 
one of the devices has no stored image at a time. 

3. A high speed imaging apparatus according to daim 
1 , wherein the apparatus includes means for erasing 
two or more devices ahead of the one being exposed 
so that image information received by the device 
after as well as before the trigger signal can be 
recorded and subsequently read from the appara- 
tus. 

4. A high speed imaging apparatus according to daim 
3, wherein the apparatus has N (where N is more 
than two) devices, up to N minus M (where M is 1 to 
N) of these having no stored image at any given time 
so that at the time of receipt of the trigger signal, N 
minus M devices are available to store up to the next 
N minus M Images following the trigger signal and 
M device(s) contain(s) an image received by the 
apparatus before the trigger signal. 

5. An apparatus for high speed imaging in two dimen- 
sions, comprising a plurality of image storing 
devices arranged for receiving and storing innages 
in two dimensions, exposure means for exposing 
respective ones of the devices to respective images 
of a sequence of innages received by the apparatus, 
updating or substituting means for updating or sub- 
stituting respective previously stored images in the 
devices by the step of exposing, means for receiving 
a trigger signal indicative of detection of an event, 
means for stopping the exposure of the devices and 
the updating or substituting in response to receipt of 
the trigger signal, and means for reading stored 
images from the devices exposed at least before 
receipt of the trigger signal whereby at least one 
image received by the apparatus before receipt of 
the trigger dgnal can be read from the apparatus 
after receipt of the trigger signal. 

6. A high speed imaging apparatus according to any 
one of the preceding daims, wherein the image stor- 
ing devices are semiconductor devices 

7. A high speed imaging apparatus according to any 
one of the preceding daims, wherein the erasure 
means indudes an anti-blooming gate. 

8. A method of high speed imaging in two dimensions, 
comprising receiving and storing images in two 
dimensions in a plurality of image storing devices, 
exposing respective ones of the devices to respec- 
tive images of a sequence of images received by the 
apparatus, updating or substituting respective pre- 
viously stored images in the devices by the step of 
exposing, receiving a trigger signal indicative of 
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detection of an event, stopping the exposure of the 
devices and the updating or substituting in response 
to receipt d the trigger signal, and reading stored 
images fr m th devices exposed at least before 
receipt of the trigger signal whereby at least one 5 
image received by the apparatus before receipt of 
the trigger signal can be read from the apparatus 
after receipt of the trigger signal. 

9. A method according to daim 8, wherein the step of 10 
updating or substituting is performed by ovenwriting 
the previously stored image with the new image. 

10. A method according to daim 8, wherein the step of 
updating or substituting is performed by erasing the is 
previously stored image prior to exposure. 

11. A method according to daim 10. Induding erasing 
the devices immediately prior to exposure so that 
only one device has no stored image at a time. 20 

12. A method according to daim 10. induding erasing 
two or more devices ahead of the one being exposed 
so that image information received by the device 
after as well as before the trigger signal can be 25 
recorded and subsequently read from the appara- 
tus. 
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